Information processing apparatus, information processing method, and non-transitory storage medium

ABSTRACT

A predetermined image correction process is automatically performed on an image, and information for identifying that the predetermined image correction process has been performed is displayed in a state that an image having undergone the predetermined image correction process is being displayed.

BACKGROUND OF THE INVENTION Field of the Invention

The present disclosure relates to an information processing apparatusfor performing image correction processing, an information processingmethod, and a non-transitory storage medium.

Description of the Related Art

Mobile terminals having advanced information processing functionality,such as a smart phone and a tablet PC, have been widely popular. Each ofthese mobile terminals may have a camera for image-capturing, and animage-capturing function using such a camera can be used for capturingan image of a subject. Some of applications using such a mobile terminalmay capture an image of a subject by using the image-capturing functionand then perform an image correction process on the captured image ofthe subject.

Japanese Patent Laid-Open No. 2016-143966 discloses a mobile terminalwhich identifies whether a subject on an image is a document or a whiteboard and performs an image correction process on the identified subject(a document or a white board).

A mobile terminal application in recent years may start a camera in themobile terminal and may display in real time, on a display unit of themobile terminal, a video image (live view video image) of a subjectbeing image-captured by the camera until a shutter button is pressed. Auser may press the shutter button by checking the live view video at thesame time. Then, the application may obtain an image of a subject andreceive a user's selection of an image correction process. Theapplication may then perform the image correction process selected bythe user on the obtained image. The application may then display animage having undergone the image correction process.

Here, in order to reduce the complexity for a user to select an imagecorrection process, an image correction process determined in advance(or a predetermined image correction process) may be performed on theobtained image. In this case, typically it is not known from thedisplayed image whether the predetermined image correction process hasbeen performed or not.

SUMMARY OF THE INVENTION

According to an aspect of the present disclosure, an informationprocessing apparatus includes an obtain unit configured to obtain animage in response to an instruction from a user, an image correctionunit configured to perform an image correction process on the obtainedimage, and a display unit configured to display an image havingundergone the image correction process performed by the image correctionunit. The image correction unit performs a predetermined imagecorrection process on the image obtained by the obtain unit in responseto the instruction. The display unit displays information foridentifying the performed predetermined image correction process in astate that the image having undergone the predetermined image correctionprocess is being displayed.

Further features of the present invention will become apparent from thefollowing description of exemplary embodiments with reference to theattached drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIGS. 1A and 1B illustrate outer appearances of a mobile terminal.

FIG. 2 is a hardware block diagram illustrating a mobile terminal.

FIG. 3 is a flowchart illustrating a process according to an embodiment.

FIG. 4 is a flowchart illustrating a process according to an embodiment.

FIGS. 5A and 5B are schematic diagrams illustrating screens displayed onthe mobile terminal.

FIG. 6 is a schematic diagram illustrating a screen displayed on themobile terminal.

FIG. 7 is a schematic diagram illustrating a screen displayed on themobile terminal.

FIG. 8 is a schematic diagram illustrating a screen displayed on themobile terminal.

FIG. 9 is a schematic diagram illustrating a screen displayed on themobile terminal.

FIG. 10 is a schematic diagram illustrating a screen displayed on themobile terminal.

FIG. 11 is a schematic diagram illustrating a screen displayed on themobile terminal.

FIG. 12 is a schematic diagram illustrating a screen displayed on themobile terminal.

FIG. 13 is a schematic diagram illustrating a screen displayed on themobile terminal.

DESCRIPTION OF THE EMBODIMENTS

Embodiments of the present disclosure will be described below withreference to drawings.

First Embodiment

FIGS. 1A and 1B illustrate outer appearances of a mobile terminal (suchas an information processing apparatus or an image processing apparatus)101 according to a first embodiment. FIG. 1A illustrates a front side ofthe mobile terminal 101. The front side has a touch panel display 102and an operation button 103 thereon. FIG. 1B illustrates a back side ofthe mobile terminal 101. The back side has a camera 104 thereon. Themobile terminal 101 provides an image-capturing function using thecamera 104. This embodiment can use any terminal apparatus having animage-capturing function. In other words, this embodiment can use asmart phone or a cellular phone having an image-capturing function or adigital camera having a communication function. The camera 104 has anauto-focus mechanism (not illustrated) and is configured toautomatically detect an in-focus state based on a contrast ratio and aninfrared ray transmission/reception time so that a focal distance or asubject distance can be measured.

FIG. 2 is a hardware block diagram illustrating the mobile terminal 101.However, the block diagram is given merely for illustrating an exampleof a configuration for implementing this embodiment.

Referring to FIG. 2, a CPU 201, a RAM 202, and a ROM 203 transmit andreceive a program and data via a data bus 211. To the data bus 211, astorage unit 204, a data transmitting/receiving unit 205, an imagingunit 206, a display unit 207, an operating unit 208, and a motion sensor210 are connected. Additionally, those components and the CPU 201, theRAM 202, and the ROM 203 can transmit and receive a program and datamutually.

The storage unit 204 may be a flash memory and is configured to storeimage data and a program for executing processing illustrated in FIG. 3.

The data transmitting/receiving unit 205 may have a wireless LANcontroller and is configured to implement transmission/reception of datato/from an external device.

The imaging unit 206 may be a camera or an image sensor and isconfigured to obtain an image of a subject such as a document or a whiteboard by image-capturing the subject. Data of the obtained image(captured image) may be provided along with header information includinga manufacturer's name and a model name of the mobile terminal, an imageresolution, a diaphragm (F value), and a focal distance, which is thentransmitted to corresponding units.

The display unit 207 may be a touch panel display and is configured todisplay a live view video image of a subject and a shutter button forimage-capturing using camera functionality.

The operating unit 208 may be a touch panel or an operation button andis configured to receive a user operation and transmit information onthe operation to a corresponding unit.

The motion sensor 210 may include a three-axis acceleration sensor, anelectronic compass, and a three-axis angular velocity sensor and isconfigured to be capable of detecting an orientation or a movement ofthe mobile terminal 101 by utilizing publicly known technologies.

The CPU 201 may execute a program held in the ROM 203 or the storageunit 204 to control a component within the mobile terminal 101.

The embodiment is applicable to any terminal apparatus having a displayunit and an operating unit. In other words, the embodiment is applicableto a smart phone and a tablet terminal having a touch panel display anda PC with a mouse and a touch panel.

User interface (UI) screens illustrated in FIGS. 5A and 5B to 13 will bedescribed. Those UI screens may be displayed by application programsheld in the storage unit 204 and executed by the CPU 201.

Next, FIGS. 5A and 5B will be described. FIG. 5A illustrates a screen501 to be displayed on the display unit 207 when the CPU 201 executes anapplication program held in the storage unit 204. The screen 501 is anentire top screen of the application to be displayed on the display unit207 of the mobile terminal.

A display field 502 displays a name (“Print App”) of an applicationinstalled and executed by the CPU 201.

An icon 503 represents a name (“Printer XYZ”) of a printer connected tothe mobile terminal.

A capture settings button 504 is a button usable by a user for settingthe type of image correction process to be performed first on a capturedimage. When a user presses the button 504, the display on the displayunit 207 is changed from the screen illustrated in FIG. 5A to a screen,not illustrated. On the screen, the user can select an image correctionmode to be applied to a captured image from a plurality of types ofimage correction mode (image correction process), which will bedescribed below. For example, when a document image correction processmode is selected and is set, the image document correction process fordocument is first performed on an image of a subject captured by a user,and a result thereof is then displayed. According to this embodiment,the button 504 is provided so that an image correction mode can be set.However, a fixed image correction mode can be set at all times withoutthe button 504. In other words, a document image correction process modemay be set fixedly as a default image correction process to beautomatically performed first on a captured image. Alternatively,without the button 504, an image correction process performed last timemay be set to perform. A “mode for performing no image correctionprocess” may be included in settable image correction modes. When themode is set, no image correction process is performed on a capturedimage. The following descriptions assume that the document imagecorrection process mode is set to be performed on a captured image.

A capture icon 505 is an icon to be pressed by a user for using animage-capturing function using the camera 104 of the mobile terminal101. When the icon is pressed, the CPU 201 starts the camera 104 of themobile terminal 101 and shifts it to an image-capture enabled state(FIG. 5B). The starting the camera 104 includes invoking and executing acontrol application for the camera 104 included in the mobile terminal101.

FIG. 5B illustrates a screen 509 to be displayed on the display unit 207by the CPU 201 for enabling to capture an image of a subject. The screen509 includes (or displays) a display area 510, a shutter button 511, andan image call icon 512 but does not include (or not display) an icon ora name of a preset image correction mode (such as an icon or a textstring representing a “DOCUMENT”). In other words, information foridentifying a type of image correction process is not displayed while alive view video image which can receive an image-capturing instructionfrom a user is being displayed so that visually unclear display of thelive view video image of the subject can be prevented.

The display area 510 is an area displaying a live view video image of asubject for live view image-capturing. The live view video image is amoving image to be displayed under control of the CPU 201 and may be areal time video image of a subject captured by the camera 104, forexample. A user can press the shutter button by checking a displayedlive view video image at the same time. The CPU 201 is configured tocapture an image of a subject in response to detection of a press by auser of the shutter button while a live view video image is beingdisplayed. In other words, the CPU 201 keeps displaying a live viewvideo image of a subject on the display area 510 until a user pressesthe shutter button.

The shutter button 511 functions as a unit for receiving an instructionfor capturing an image of a subject from a user while a live view videoimage is being displayed, as described above. When the shutter button511 is pressed, the CPU 201 uses a control application for the camera104 to capture an image of the subject image-captured by the camera 104.The CPU 201 changes the display content on the display unit to a screenillustrated in FIG. 6 by setting the captured image as a target for animage correction process, which will be described with reference to FIG.6 and subsequent figures. Instead of the shift to the screen asillustrated in FIG. 6 immediately after the shutter button 511 ispressed, the captured image may be displayed once on the display area510, and, in response to confirmation by a user, the screen displayed onthe display unit 207 may be shifted to the screen 601 in FIG. 6.

If a user presses the icon 512, the CPU 201 displays a list of imagessaved in the storage unit 204 on the display unit, and changes thedisplay to the screen as illustrated in FIG. 6 by setting the imageselected by a user from the list as a target of an image correctionprocess, which will be described with reference to FIG. 6 and subsequentfigures. Instead of the shift to the screen 601 in FIG. 6 immediatelyafter an image is selected from the list, the selected image may bedisplayed as a still image once on the display area 510 and, in responseto confirmation by a user, the screen may be shifted to the screen inFIG. 6. The following descriptions assume that an image of a subjectimage-captured in response to an image-capture instruction is set as atarget of an image correction process.

Next, FIG. 6 will be described. FIG. 6 illustrates the screen 601 to bedisplayed on the display unit 207 by the CPU 201. The screen 601 is ascreen for receiving a user operation for performing a keystonecorrection process. On the screen 601, an area to undergo the keystonecorrection process is to be designated. The keystone correction processaccording to this embodiment is processing for performing geometriccorrection on an image in the area designated of the captured image to arectangular or square shape. This image cut-out processing may also becalled cropping processing.

FIG. 6 further illustrates a display field 602 displaying a name(“KEYSTONE CORRECTION”) of a screen displayed on the display unit 207.

FIG. 6 further illustrates a display area 603 displaying a capturedimage of a subject. The display area 603 displays a cropping frame 604and handlers for transforming the cropping frame 604, which will bedescribed below.

The cropping frame 604 displays a cut-out processing area to undergo akeystone correction process. The handlers for transforming the frame 604are set at four corners of the frame 604 and the middle point of eachborder of the frame 604 and are to be operated by a user.

An icon 606 is a selection icon usable for instructing an aspect ratioof an image having undergone the keystone correction process. FIG. 6illustrates a state that “AUTOMATIC” is selected. The aspect ratio isselectable from “AUTOMATIC/A4/LTR”.

An icon 607 is a selection icon usable for instructing to move to thenext processing step. When the icon 607 is pressed by a user, thedisplayed screen is shifted to a screen 701 illustrated in FIG. 7. Forthe screen shift, the CPU 201 performs a keystone correction process onthe image of the area designated in the cropping frame 604 and performsan image correction process based on a preset image correction mode onthe image having undergone the keystone correction process. According tothis embodiment, a document image correction process is performed, asdescribed above. The document image correction process removes shadowshown in an image to increase the brightness of the image. The CPU 201then displays the corrected image on the screen 701 illustrated in FIG.7.

FIG. 7 will be described. The screen 701 in FIG. 7 is a screen displayedon the display unit 207 by the CPU 201. The screen 701 is a screenusable by a user for confirmation before the image having undergone theimage correction process is saved and usable for receiving a useroperation for changing the type of image correction process. The screen701 displays a result of the image correction process based on a presetimage correction mode on the image having undergone a keystonecorrection process and a name of the image correction mode (orinformation for identifying the type of image correction process).

FIG. 7 illustrates a display field 702 displaying a name (“IMAGECORRECTION MODE”) of a screen displayed on the display unit 207.

FIG. 7 further includes a display area 703 displaying a result of theimage correction process based on a preset image correction mode. Here,the display area 703 displays a result of a performed document imagecorrection process.

FIG. 7 illustrates an icon 704 that is a selection icon usable forinstructing to rotate (by 90 degrees/180 degrees/270 degrees) the imagedisplayed in the display area 703 on the display unit 207. When a userpresses the selection icon, rotation angle options (90 degrees/180degrees/270 degrees) (not illustrated) are displayed. When a userselects an arbitrary rotation angle from the options, the CPU 201performs rotation processing by the rotation angle designated for theimage 703 displayed on the display unit 207. After that, the CPU 201stores the rotated image in the storage unit 204 and displays it on thedisplay unit 207.

FIG. 7 further illustrates an icon 705 representing a name of an imagecorrection process to be applied to the image displayed in the displayarea 703. The icon 705 displays identification information foridentifying the type of image correction process along with an imagehaving undergone the image correction process. Here, “DOCUMENT” isdisplayed. Displaying the identification information, which is notdisplayed while a live view video image of a subject is being displayed(FIG. 5B), along with an image having undergone an image correctionprocess may facilitate identification by a user of the type of imagecorrection process that has been performed. Having described that,according to this embodiment, a name (text string) of the type of imagecorrection process is given as the identification information, an iconrepresenting the type of image correction process may be displayed. Whena user presses the icon 705, the CPU 201 additionally displays a list804 of image correction processes on the display unit 207, asillustrated in FIG. 8.

The icon 706 is a selection icon for instructing to move to saving (thenext processing step). When a user presses the icon 706, the CPU 201converts the format of the image displayed in the display area 703 to aPDF file and displays a screen 1201 as illustrated in FIG. 12 includinga preview of the PDF file on the display unit 207.

Next, FIG. 8 will be described. FIG. 8 illustrates a screen 801 to bedisplayed on the display unit 207 by the CPU 201. The screen 801 is ascreen for receiving a selection of image correction mode from a userand provides options to the user.

The list 804 is a list of image correction process options.

An option 806 indicates that the type of image correction process to beperformed on an image having undergone the keystone correction processis a document image correction process. When the option 806 is pressedby a user, the CPU 201 performs the document image correction process onthe image having undergone the keystone correction process and displaysthe screen 701 illustrated in FIG. 7.

An option 807 indicates that the type of image correction process to beperformed on an image having undergone the keystone correction processis a white board image process. When the option 807 is pressed by auser, the CPU 201 removes shadow shown on the image having undergone thekeystone correction process to increase the brightness of the image andperforms an image correction process to monochromatically display acluster part having similar colors in the image having the increasedbrightness. The CPU 201 then displays a screen 901 illustrated in FIG. 9including the image having undergone the image correction process.

An option 808 also indicates the type of image correction process to beperformed on an image having undergone the keystone correction processis a white board image process. The option 808 and the option 807 aredifferent in size of the cluster part to be monochromatically displayed.When the option 808 is pressed by a user, the CPU 201 removes shadowshown on the image having undergone the keystone correction process toincrease the brightness of the image and performs an image correctionprocess to monochromatically display a cluster part having similarcolors in the image having the increased brightness. For detection ofthe cluster part, a part having a size larger than that of the clusterpart detected based on the option 807 is to be detected. The CPU 201then displays a screen 1001 as illustrated in FIG. 10 including theimage having undergone the image correction process.

An option 809 may be selected to perform no types of image correctionprocess on an image having undergone the keystone correction process.When the option 809 is pressed by a user, the CPU 201 displays a screen1101 illustrated in FIG. 11 including the image having undergone akeystone correction process as it is.

An option 810 may be selected to cancel a change of the type of imagecorrection process. When the option 810 is pressed by a user, the CPU201 cancels the additional display of the list 804 and again displaysthe screen displayed when the list 804 is called. For example, in a casewhere the icon 705 is pressed to call the list 804 when the screen 701in FIG. 7 is displayed, the screen 701 in FIG. 7 is displayed again inresponse to the press of the option 810.

Next, FIG. 9 will be described. FIG. 9 illustrates a screen 901 to bedisplayed on the display unit 207 by the CPU 201. The screen 901 isusable by a user for confirmation before an image having undergone animage correction process is saved and is also usable for receiving auser operation for changing the type of image correction process. Thescreen 901 displays a result of the image correction process in theimage correction mode based on the option 807 performed on the imagehaving undergone the keystone correction process and a name of the imagecorrection mode (or information for identifying the type of imagecorrection process).

FIG. 9 further illustrates a display field 902 similar to the displayfield 702.

FIG. 9 further illustrates a display area 903 displaying a result of theimage correction process in the image correction mode based on theoption 807. Referring to FIG. 9, the display area 903 displays a resultof a first image correction process for whiteboard.

An icon 904 in FIG. 9 is similar to the icon 704.

FIG. 9 further illustrates an icon 905 which displays the name of theimage correction process applied to the image displayed on the displayarea 903, similarly to the icon 705. Referring to FIG. 9, the icon 905displays “WHITE BOARD 1” indicating the first image correction processfor white board. When a user presses the icon 905, the CPU 201additionally displays a list 804 of image correction processes on thedisplay unit 207, like the screen in FIG. 8.

FIG. 9 further illustrates an icon 906 that is a selection icon usablefor instructing to save (next processing step). When a user presses theicon 906, the CPU 201 converts the format of the image displayed in thedisplay area 903 to a PDF file and displays a screen 1201 as illustratedin FIG. 12 including a preview of the PDF file on the display unit 207.

Next, FIG. 10 will be described. FIG. 10 illustrates a screen 1001 to bedisplayed on the display unit 207 by the CPU 201. The screen 1001 isusable by a user for confirmation before an image having undergone animage correction process is saved and is also usable for receiving auser operation for changing the type of image correction process. Thescreen 1001 displays a result of the image correction process in theimage correction mode based on the option 808 performed on the imagehaving undergone a keystone correction process and a name of the imagecorrection mode (or information for identifying the type of imagecorrection process).

FIG. 10 further illustrates a display field 1002 similar to the displayfield 702.

FIG. 10 further illustrates a display area 1003 displaying a result ofthe image correction process in the image correction mode based on theoption 808. Referring to FIG. 10, the display area 1003 displays aresult of a second image correction process for white board.

An icon 1004 in FIG. 10 is similar to the icon 704.

FIG. 10 further illustrates an icon 1005 which displays the name of theimage correction process applied to the image displayed on the displayarea 1003, similarly to the icon 705. Referring to FIG. 10, the icon1005 displays “WHITE BOARD 2” indicating the second image correctionprocess for white board. When a user presses the icon 1005, the CPU 201additionally displays a list 804 of image correction processes on thedisplay unit 207, like the screen in FIG. 8.

FIG. 10 further illustrates an icon 1006 that is a selection icon usablefor instructing to save (next processing step). When a user presses theicon 1006, the CPU 201 converts the format of the image displayed in thedisplay area 1003 to a PDF file and displays a screen 1201 asillustrated in FIG. 12 including a preview of the PDF file on thedisplay unit 207.

Next, FIG. 11 will be described. FIG. 11 illustrates a screen 1101 to bedisplayed on the display unit 207 by the CPU 201. The screen 1101 isusable by a user for confirmation before an image having undergone animage correction process is saved and is also usable for receiving auser operation for changing the type of image correction process. Thescreen 1101 is usable by a user for confirmation before an image havingundergone an image correction process is saved and is also usable forreceiving a user operation for changing the type of image correctionprocess.

FIG. 11 further illustrates a display field 1102 similar to the displayfield 702.

FIG. 11 further illustrates a display area 1103 displaying an image inthe image correction mode based on the option 809. Referring to FIG. 11,the display area 1103 displays an image having undergone the keystonecorrection process only without any type of image correction processcorresponding to the options 806 to 808.

An icon 1104 in FIG. 11 is similar to the icon 704.

FIG. 11 further illustrates an icon 1105 indicating that none of imagecorrection processes corresponding the options 806 to 808 has beenperformed. Thus, the icon 1105 displays “NO IMAGE CORRECTION”. When auser presses the icon 1105, the CPU 201 additionally displays a list 804of image correction processes on the display unit 207, like the screenin FIG. 8.

FIG. 11 further illustrates an icon 1106 that is a selection icon usablefor instructing to save (next processing step). When a user presses theicon 1106, the CPU 201 converts the format of the image displayed in thedisplay area 1103 to a PDF file and displays a screen 1201 asillustrated in FIG. 12 including a preview of the PDF file on thedisplay unit 207.

Next, FIG. 12 will be described. FIG. 12 illustrates a screen 1201 to bedisplayed on the display unit 207 by the CPU 201. The screen 1201 isusable by a user for setting an output destination of the PDF fileobtained by the format conversion. The screen 1201 includes (ordisplays) a display field 1202, a display area 1203, an icon 1204, anicon 1205, and an icon 1206.

The display field 1202 displays a name (“20170329150834.pdf”) of a PDFfile to be output.

The display area 1203 displays an output preview of the PDF file. TheCPU 201 generates the output preview based on a PDF file saved inresponse to a user press of the icon 706, 906, 1006, or 1106. Thedisplay content may correspond to the image displayed in the displayarea 703, 903, 1003, or 1103.

FIG. 12 illustrates an icon 1204 to be pressed by a user for setting astorage destination for storing a PDF file. When a user presses theicon, the CPU 201 displays a screen (not illustrated) usable by a userfor selecting a storage destination for a PDF file and sets a storagedestination selected by a user as a storage destination for the PDFfile.

The icon 1205 may be pressed by a user for setting a destination for aPDF file. When a user presses the icon, the CPU 201 displays a screen onwhich a user can select an application (such as an electronic mailapplication or a Bluetooth (registered trademark) communicationapplication) to be used for transmitting a PDF file. The CPU 201 thenuses the application based on the user selection to set the destinationfor the PDF file and transmit the PDF file to the destination.

The icon 1206 is to be pressed by a user for setting a printer forprinting a PDF file. When a user presses the icon, the CPU 201 displaysa screen 1301 illustrated in FIG. 13 on the display unit 207.

The screen 1301 will be described. The screen 1301 can be operated by auser for setting a printer for printing a PDF file. A name(identification information) 1305 of the printer set on the screen 1301is displayed. The screen includes (or displays) an area 1306 displayingprint settings (or a part thereof) (hereinafter, printer settings 1306)for printing a PDF file by the set printer and a display area 1303 for aprint preview of the PDF file based on the print settings. The screen1301 further includes an icon 1307 for receiving an instruction to printa PDF file based on print settings defined by a user.

The display area 1303 may display a print preview of a PDF file. Theprint preview is generated by the defined print settings.

FIG. 13 illustrates information 1304 indicating the page number of adisplayed image and the total number of pages. According to the exampleshown in FIG. 13, the information 1304 indicates 1/1, which means thefirst page is being displayed, and the total number of pages is equal toone.

FIG. 13 further illustrates identification information 1305 indicating aname of a printer for printing a PDF file. The information 1305 can bepressed by a user and when a user presses the information icon, the CPU201 displays a printer selection screen, not illustrated, and canreceive a printer selection from a user. The CPU 201 then sets a printerselected by a user as a printer for printing a PDF file.

The print settings 1306 displays defined print settings. According tothis embodiment, the print settings 1306 displays a set sheet size (A4),a number of copies (1), and a print range (ALL). The print settings 1306can be pressed by a user. When a user presses the print settings 1306,the CPU 201 displays a print setting change screen, not illustrated.Through the screen, a user can change a setting of the print settings.

The print instruction icon 1307 may be pressed by a user for printing aPDF file by using a set printer. In response to a print instruction froma user based on a press of the icon 1307, the CPU 201 transmits a PDFfile and defined print settings to the set printer through the datatransmitting/receiving unit 205. When the printer receives the PDF fileand the print settings, the printer prints the PDF file based on theprint settings.

Up to this point, the screens illustrated in FIGS. 5A and 5B to 13 havebeen described which are to be displayed by the CPU 201 based on theapplication program.

Next, a flow of processing for displaying the screens illustrated inFIGS. 5A and 5B to 13 based on the application program by the CPU 201will be described with reference to the flowcharts illustrated in FIGS.3 and 4. The processing illustrated in the flowchart in FIG. 3 can beimplemented by an application program stored in the storage unit 204 andexecuted by the CPU 201. The flowchart is for printing where thedocument image correction mode is preset.

In step S301, the CPU 201 starts the processing in the flowchart.

In step S302, the CPU 201 displays a top screen (screen 501 illustratedin FIG. 5A) of the application on the display unit 207. When the CPU 201detects that a user has pressed the capture icon 505 on the screen, theprocessing moves to step S303.

In step S303, the CPU 201 starts the camera 104 and displays the screen509 illustrated in FIG. 5B on the display unit 207. The screen displaysa live view video image of a subject, as described above, but does notdisplay information for identifying the type of image correction processto be executed in step S306, which will be described below. When the CPU201 detects that a user has pressed the shutter button 511 while thescreen 509 is being displayed, the processing moves to step S304.

In step S304, the CPU 201 obtains an image of a subject captured by thecamera 104. In other words, the CPU 201 obtains an image captured inresponse to an image-capture instruction from a user. The captured imageis temporarily held in the storage unit 204.

Next, in step S305, the CPU 201 displays the screen (FIG. 6) for settinga target area to undergo a keystone correction process on the displayunit 207. If the CPU 201 detects that a user has pressed the icon 607,the processing moves to the next step.

In step S306, the CPU 201 executes a keystone correction process on animage in the area designated in the cropping frame 604. The CPU 201stores the image having undergone the keystone correction process in akeystone-corrected image storage area within the storage unit 204.

Next in step S307, the CPU 201 may select a preset (or predetermined)image correction mode from a plurality of predetermined image correctionmodes. It is assumed here that the document image correction mode isselected.

Next in step S308, the CPU 201 sets a name of the image correction modeselected in step S307. In this case, the CPU 201 stores the name of theimage correction mode in a process name storage area within the storageunit 204. Here, the CPU 201 stores “DOCUMENT” as an image correctionprocess name in the process name storage area within the storage unit204.

In step S309, the CPU 201 reads out the image having undergone thekeystone correction process and stored in the keystone-corrected imagestorage area and performs the image correction process corresponding tothe image correction mode stored in the process name storage area on theread image. Here, the image correction process corresponding to thedocument image correction mode is executed. After that, the CPU 201stores a resulting image of the applied image correction process in acorrected image storage area within the storage unit 204. In otherwords, the processing in steps S307 to S309 corresponds to automaticexecution of a predetermined image correction process without receivinga selection of an image correction process from a user. The imagecorrection processes will be described in detail with reference to theflowchart in FIG. 4.

In step S310, the CPU 201 displays the image having undergone the imagecorrection process and stored in the corrected image storage area andthe name stored in the process name storage area on the correspondingdisplay area and icon, respectively.

For example, in step S310 subsequent to step S309, the CPU 201 displaysthe screen 701 illustrated in FIG. 7 on the display unit 207. In thiscase, the CPU 201 reads out a resulting image of the applied imagecorrection process from the corrected image storage area within thestorage unit 204 and displays it in the display area 703 on the screen701. The CPU 201 reads out the image correction mode name stored in theprocess name storage area within the storage unit 204 and displays it onthe icon 705 on the display unit 207. This may facilitate a user tograsp the type of image correction process performed on the image beingdisplayed in the display area 703. In other words, the CPU 201automatically displays the image having undergone an image correctionprocess and the name of the image correction mode. The expression“automatically displays” refers to displaying a name (on the icon 705)of an image correction process in association with display of an imagehaving undergone the image correction process without additionallyreceiving an instruction to display the name from a user.

For example, in step S310 subsequent to step S319, which will bedescribed below, the CPU 201 displays the image having undergone theimage correction process in S319 in the corresponding display area anddisplays the name of the image correction mode corresponding to theimage correction process on the corresponding icon. Thus, thecorresponding one of the screens illustrated in FIGS. 7, 9, 10, and 11may be displayed.

If the CPU 201 detects in step S311 that a user has pressed the nameicon (705, 905, 1005, 1105) corresponding to the target image correctionprocess, the processing moves to step S312 where the list 804 isadditionally displayed, like the screen 801 in FIG. 8. If the CPU 201detects that a user has pressed the save icon (706, 906, 1006, 1106) instep S311, the processing moves to step S320.

If the CPU 201 in step S312 detects that one of the plurality of optionsin the list 804 illustrated in FIG. 8 has been selected, the CPU 201identifies which option has been selected. If the CPU 201 identifiesthat the option 806 has been pressed, the processing moves to step S313.If the CPU 201 identifies that the option 807 has been selected, theprocessing moves to step S314. If the CPU 201 identifies the option 808has been selected, the processing moves to step S315. If the CPU 201identifies that the option 809 has been pressed, the processing moves tostep S313. If the CPU 201 identifies that the option 810 has beenselected, the processing moves to step S311.

In step S313, the CPU 201 stores “DOCUMENT” as a name corresponding tothe image correction process to be applied hereafter in a temporary areawithin the storage unit 204.

In step S314, the CPU 201 stores “WHITE BOARD 1” as a name correspondingto the image correction process to be applied hereafter in a temporaryarea within the storage unit 204.

In step S315, the CPU 201 stores “WHITE BOARD 2” as a name correspondingto the image correction process to be applied hereafter in a temporaryarea within the storage unit 204.

In step S316, the CPU 201 stores “NO IMAGE CORRECTION” as a name toindicate that no image correction process is to be applied in thetemporary area within the storage unit 204.

In step S317, the CPU 201 determines whether the name stored in theprocess name storage area within the storage unit 204 and the namestored in the temporary area within the storage unit 204 are matched ornot. If so, the CPU 201 advances the processing to step S310. If not,the CPU 201 advances the processing to step S318.

In step S318, the CPU 201 overwrites and stores the name stored in thetemporary area within the storage unit 204 in the process name storagearea within the storage unit 204.

In subsequent step S319, the CPU 201 reads out the image havingundergone the keystone correction process from the keystone-correctedimage storage area within the storage unit 204 and performs the imagecorrection process corresponding to the image correction mode stored inthe process name storage area on the read image. The CPU 201 then storesthe image having undergone the image correction process in the correctedimage storage area within the storage unit 204. The image correctionprocesses will be described in detail with reference to the flowchart inFIG. 4. The CPU 201 then advances the processing to step S310.

In step S320, the CPU 201 converts the format of the image havingundergone the image correction process to a PDF file and stores it in afile storage area within the storage unit 204. Having described that aPDF format is applied as the converted format, other file formats may beapplied. The file format may be processable by a printer. Then, the CPU201 displays the screen 1201 in FIG. 12 on the display unit 207. If theCPU 201 detects that the icon 1206 on the screen 1201 has been pressedby a user, the processing moves to step S321.

In step S321, the CPU 201 displays the screen 1301 in FIG. 13 on thedisplay unit 207. Here, defining or changing a setting for a printer forprinting may be performed. If the CPU 201 detects that the printinstruction icon 1307 has been pressed by a user, the processing movesto step S322.

In step S322, the CPU 201 transmits a PDF file stored in the filestorage area and print settings to the set printer (such as “PrinterXYZ”).

In step S323, the CPU 201 ends the processing in the flowchart.

Through the processing in the flow, a keystone correction process and animage correction process can be performed on a captured image, and theprocessed image can be printed. Though this flow dose not displayinformation for identifying the applied type of image correction processin the live view video image of a subject that is being displayed, thescreen after the image correction process is performed displays theinformation for identifying the applied type of image correctionprocess. This can prevent unclear display of the live view video of asubject to be image-captured and can facilitate a user to grasp whichone of a plurality of types of image correction process has beenapplied.

Next, the image correction processes will be described with reference tothe flowchart in FIG. 4.

In step S401, the CPU 201 starts the processing in the flowchart.

In step S402, the CPU 201 reads out a name from the process name storagearea within the storage unit 204.

In step S403, the CPU 201 reads out an image having undergone a keystonecorrection process from the keystone-corrected image storage area withinthe storage unit 204.

In step S404, the CPU 201 applies the image correction processcorresponding to the read name on the image having undergone thekeystone correction process and stores the processed image in thecorrected image storage area within the storage unit 204. According tothis embodiment, a plurality of predetermined image correction processesare available which correspond to the names “DOCUMENT”, “WHITE BOARD 1”,“WHITE BOARD 2”, and “NO IMAGE CORRECTION”. For example, the imagecorrection process corresponding to the name “DOCUMENT” performs theshadow removal processing on an image having undergone a keystonecorrection process. The image correction process corresponding to thename “WHITE BOARD 1” performs monochromating processing on the imagehaving undergone the keystone correction process to monochromaticallydisplay a cluster part having similar colors indicated by a marker inthe image in addition to the shadow removal processing. The imagecorrection process corresponding to the name “WHITE BOARD 2” performsprocessing for expanding monochromated area on the image havingundergone the keystone correction process in addition to the processingcorresponding to the name “WHITE BOARD 1”. The processing correspondingto the name “NO IMAGE CORRECTION” performs no type of image correctionprocess on the image having undergone the keystone correction process.

In step S405, the CPU 201 ends the processing in the flowchart.

According to the present disclosure, information for identifying apredetermined image correction process that has been performed can bedisplayed in a state that the image having undergone the predeterminedimage correction process is displayed.

Other Embodiments

Embodiment(s) of the present invention can also be realized by acomputer of a system or apparatus that reads out and executes computerexecutable instructions (e.g., one or more programs) recorded on astorage medium (which may also be referred to more fully as a‘non-transitory computer-readable storage medium’) to perform thefunctions of one or more of the above-described embodiment(s) and/orthat includes one or more circuits (e.g., application specificintegrated circuit (ASIC)) for performing the functions of one or moreof the above-described embodiment(s), and by a method performed by thecomputer of the system or apparatus by, for example, reading out andexecuting the computer executable instructions from the storage mediumto perform the functions of one or more of the above-describedembodiment(s) and/or controlling the one or more circuits to perform thefunctions of one or more of the above-described embodiment(s). Thecomputer may comprise one or more processors (e.g., central processingunit (CPU), micro processing unit (MPU)) and may include a network ofseparate computers or separate processors to read out and execute thecomputer executable instructions. The computer executable instructionsmay be provided to the computer, for example, from a network or thestorage medium. The storage medium may include, for example, one or moreof a hard disk, a random-access memory (RAM), a read only memory (ROM),a storage of distributed computing systems, an optical disk (such as acompact disc (CD), digital versatile disc (DVD), or Blu-ray Disc (BD)™),a flash memory device, a memory card, and the like.

While the present invention has been described with reference toexemplary embodiments, it is to be understood that the invention is notlimited to the disclosed exemplary embodiments. The scope of thefollowing claims is to be accorded the broadest interpretation so as toencompass all such modifications and equivalent structures andfunctions.

This application claims the benefit of Japanese Patent Application No.2017-101043, filed May 22, 2017, which is hereby incorporated byreference herein in its entirety.

What is claimed is:
 1. An information processing apparatus comprising: adisplay; one or more memory devices that store a set of instructions;and one or more processors that execute the set of instructions to:display an image on the display; perform a first brightness correctionprocess on the image according to receiving a first instruction from auser; display, on the display, a corrected image for which the firstbrightness correction process has been performed and informationindicating a type of the first brightness correction process; receive asecond instruction to perform a second brightness correction processdifferent in type from the first brightness correction process from theuser in a state that the corrected image is displayed on the display;and perform the second brightness correction process on the imageaccording to the received second instruction.
 2. The informationprocessing apparatus according to claim 1, wherein the one or moreprocessors further cause the display to display a moving image, whereinthe one or more processors further obtain an image in response to thesecond instruction from the user in a state that the moving image isbeing displayed, and wherein the one or more processors cause thedisplay not to display the information for identifying the firstbrightness correction process to be performed on the obtained image in astate that the moving image is being displayed.
 3. The informationprocessing apparatus according to claim 2, further comprising animage-capture device, wherein the moving image is a video image capturedby the image-capture device.
 4. The information processing apparatusaccording to claim 1, wherein the one or more processors perform thesecond brightness correction process selected by the user from aplurality of brightness correction processes, and wherein the one ormore processors perform the first brightness correction process on theimage in response to the first instruction from the user, withoutreceiving a selection of a brightness correction process performed bythe user.
 5. The information processing apparatus according to claim 1,wherein the first brightness correction process is preset as a defaultbrightness correction process.
 6. The information processing apparatusaccording to claim 1, wherein the one or more processors receive, afterthe first brightness correction process is performed, from the user thesecond instruction to select the second brightness correction process ofa plurality of brightness correction processes instead of the firstbrightness correction process, and wherein the display, in response tothe second instruction to select, displays a resulting image of thesecond brightness correction process instead of the first brightnesscorrection process and information for identifying that the performedsecond brightness correction process instead of the information.
 7. Theinformation processing apparatus according to claim 1, wherein theinformation for identifying the performed first or second brightnesscorrection process is an icon or a text string indicating that a type ofthe first or second brightness correction process, respectively.
 8. Theinformation processing apparatus according to claim 4, wherein theplurality of brightness correction processes includes at least adocument brightness correction process and a white board brightnesscorrection process.
 9. The information processing apparatus according toclaim 1, wherein the one or more processors further perform a croppingprocess on the image based on an area designated by the user and toperform a keystone correction process on the image having undergone thecropping process, and wherein the first or second brightness correctionprocess is performed on the image having undergone the keystonecorrection process.
 10. An information processing method comprising:displaying an image on a display; performing a first brightnesscorrection process on the image according to receiving a firstinstruction from a user; causing a display to display, on the display, acorrected image for which the first brightness correction process hasbeen performed and information indicating a type of the first brightnesscorrection process; receiving a second instruction to perform a secondbrightness correction process different in type from the firstbrightness correction process from the user in a state that thecorrected image is displayed on the display; and performing the secondbrightness correction process on the image according to the receivedsecond instruction.
 11. The information processing method according toclaim 10, further comprising not displaying information for identifyingthe first brightness correction process to be performed on the imageobtained when receiving the second instruction from the user.
 12. Theinformation processing method according to claim 11, further comprisingdisplaying a moving image, wherein the image is obtained in response tothe second instruction from the user in a state that the moving image isbeing displayed, and wherein the not displaying does not display theinformation for identifying the first or second brightness correctionprocess to be performed on the obtained image in a state that the movingimage is being displayed.
 13. The information processing methodaccording to claim 12, further comprising image-capturing, wherein themoving image is a video image captured by the image-capturing.
 14. Theinformation processing method according to claim 10, further comprisingexecuting a-the second brightness correction process selected by theuser from a plurality of brightness correction processes on the obtainedimage, and wherein the performing performs the first brightnesscorrection process on the image in response to the first instruction,without receiving a selection of one of the plurality of brightnesscorrection processes by the user.
 15. The information processing methodaccording to claim 10, wherein the first brightness correction processis preset as a default brightness correction process.
 16. Anon-transitory storage medium storing a program which, when executed bya processor, causes the processor to perform operations comprising:displaying an image on a display; performing a first brightnesscorrection process on the image according to receiving a firstinstruction from a user; causing a display to display, on the display, acorrected image for which the first brightness correction process hasbeen performed and information indicating a type of the first brightnesscorrection process; receiving a second instruction to perform a secondbrightness correction process different in type from the firstbrightness correction process from the user in a state that thecorrected image is displayed on the display; and performing the secondbrightness correction process on the image according to the receivedsecond instruction.
 17. The information processing apparatus accordingto claim 1, wherein the first brightness correction process is adocument brightness correction process and the second brightnesscorrection process is a white board brightness correction process.